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I.  statement  of  Research  Objectives 

The  principal  thrust  of  this  research  proj^' t  is  in  the  general  areas 
of  statistical  inference  for  stochastic  processes  and  reconstruction  of 
stochastic  processes  and  deterministic  functions  from  only  partial  infor¬ 
mation  or  limited  observations.  In  the  context  of  stochastic  processes, 
emphasis  is  on  point  processes,  in  particular  Cox  processes,  and  Harkov 
(also  semi-Markov)  processes.  For  reconstruction  of  deterministic  functions, 
the  main  objective  is  to  provide  explicit  bounds  on  appropriate  measures 
of  error.  In  more  detail,  research  objectives  for  the  period  1  January, 
1982-31  December,  1982,  were  as  follows* 

Inference  and  State  Estimation  for  Derived  Random  Measures. 

As  introduced  by  Karr  (1978) ,  a  derived  random  measure  X*M  is  of  the  form 

X*M{A)  =  /  X.  M(dt), 

A  t 

where  M  is  a  random  measure  on  the  underlying  space  E(a  general  LCCB  space, 
possibly  but  not  necessarily  the  real  line  IR)  and  X  is  a  nonnegative  random 
process.  The  state  estimation  problem  for  X  and  M  is  to  estimate  with 
minimum  mean-squared  ^rror  (MMSE)  the  components  X  and  M  given  only 
observations  of  the  derived  random  measure  X*N.  Of  course,  the  estimators 
are  then  suitable  conditional  expectations;  the  key  issues  are  to  obtain 
explicit  and  recursive  expressions  for  them  as  functions  of  the  observations. 
Carrying  out  this  program  is  particularly  important  for  the  following  cases, 
which  have  application  in  tracking  and  signal  processing. 

1)  Poisson  M;  0-1  semi-Markov  X.  Initial  study  in  Karr  (1982)  treated 
the  case  of  0-1  Markov  X,  but  relied  heavily  on  both  the  Markov  nature  of  X 
and  the  property  (assuming  that  X  and  H  are  independent)  that  X*M  is  a 
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Cox  process  (doubly  stochastic  Poisson  process) .  The  latter  continues  to 
hold  for  0-1  semi-Markov  Xrand  solution  of  this  case  will  significantly 
extend  applicability  of  the  model. 

2)  Poisson  H;  general  semi-Markov  X.  Here  even  the  Cox  nature  of 
X*M  fails  to  hold  and  entirely  new  techniques  are  necessary. 

B)  Semi-Markov-modulated  Cox  processes  on  IR^.  Let  N  be  a  Cox  process 
directed  by  the  random  measure 

M(A)  =  /  X.dt, 

A  t 

where  X  is  a  nonnegative  semi-Markov  process  onlR^-  Objectives  are  to 
develop  teelmiques  for  estimation  of  the  probability  law  of  X  from 
single  realizations  of  N  (which  is  possible  only  if  X  has  ergodic  long- 
run  behavior)  and  to  devise  methods  for  realization-by-realization 
reconstruction  of  X  from  observations  of  N.  The  Markov  case  has  been 
studied  and  applied  extensively  (see,  e.g.,  Snyder  (1975))  but  little  is 
known  about  the  semi-Markov  case. 

Process  Sampling  of  Stochastic  Processes.  Given  a  stochastic 

process  (X^)  and  a  point  process  N  with  points  suppose  that  X  is 

observable  only  at  the  random  times  so  that  the  data  are  the  pairs 

(T  ,  X(T  ))  or  possibly  only  the  observed  values  X(T  ).  Furthermore,  while 
n  n  n 

the  structiiral  relationship  of  N  to  X  is  assumed  specified,  N  Itself  may 
involve  unlcnown  parameters.  The  two  principal  problems  are  to  provide 
methods  for  Inference  (estimation  and  hypothesis  testing)  concerning  the 
law  of  X  or  unknown  parameters  of  X,  together  with  unknown  parcimeters  of  N, 
and  to  develop  esqpllcit  and,  especially,  recursive  techniques  for  MMSE 
reccHistruction  of  undt>served  portions  of  the  sample  paths  of  X.  Finally 


2 


there  is  the  concatenated  problem  of  carrying  out  state  estimation 
procedures  when  parameters  of  X  must  themselves  be  estimated*  Even 
the  case  of  Markov  X  has  been  studied  only  very  incompletely. 

D)  Reconstruction  of  Deterministic  Functions.  Let  f :  (0,1]-*“  R  be 
an  unknown,  deterministic  function  satisfying  |f|  <  B  for  a  known  constant 
B.  Suppose  that  £  is  to  be  reconstructed  nonpar ametrically  from  bard- 
limited  data  of  the  form  {sgn{f (t  )  +  x.,  ):  1  <  j  <  J,  1  <  k  <  k}, 

where  t^^  €  I0,1]  are  times  at  which  f  is  sampled  and  are 

additive  "corruptions”  deliberately  imposed  before  hardlimiting  the  signal. 
Karr/Serfling  (1983)  place  the  pr<^lero  in  the  context  of  numerical  inte¬ 
gration  and  obtain  explicit  error  boiinds,  for  example,  on  ||J-f  j|^  and 
||f-f  |j^,  1  <  p  <  »,  for  the  step  function  estimator 


f(t)  =  ^  I  sgn{f(t^j^)  + 


t  e  I.. 
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These  bounds,  for  suitably  chosen  t^j^  and  x^^^,  in  turn  yield  rates  of 
convergence  as  n  =  JK  (n  is  the  number  of  evaluations  of  f)  that 
significantly  improve  those  known  for  alternative  estimators  (and  the 
latter  are  in  addition  much  more  laborious  to  calculate) •  Objectives  are 
to  extend  and  refine  the  techniques,  and  hence  broaden  their  applicability, 
in  the  following  directions. 

1)  Inclusion  of  other  transformations  of  signal  plus  "noise**  (other 
than  the  signum  function);  in  particular,  multi-level  quantizers  should  be 
analyzed. 

2)  treatment  of  averaged  observations  •  In  practice  one  would  expect 
that  rather  than  exact  point  observations  8gn{f(t)  x},  only  averaged 
observations  of  the  form 
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can  be  obtained.  Extension  to  this  case  is  of  apparent  physical  importance. 
3)  Use  of  the  Hausdorff  metric.  This  metric  (cf.  Sendov  (1969))  lies 

p 

in  some  sense  between  the  uniform  metric  and  the  L  metrics  for  I  <  p  <  ». 

It  is  particularly  applicable  to  elucidation  of  pointwise  behavior  of  the 
estimation  error  for  reconstruction  of  discontinuous  functions. 


IX.  Status  of  the  Research 

This  discussion  is  parallel  to  that  in  the  statement  of  research 
objectives. 

A) ;  B) .  Inference  and  State  Estimation  for  Point  Processes.  Neither 
of  the  problem  areas  described  in  I. A  and  I.B  above  has  yielded  to  direct 
attack f  and  it  has  been  necessary  instead  to  examine  more  general  questions 
of  inference  and  state  estimation,  mainly  for  Cox  processes  but  also,  in 
some  cases,  in  more  general  contexts*  This  line  of  research  stems  from 
Karr  (1983)  and,  after  additional  general  development  as  discussed  below, 
is  expected  to  lead  to  solution  of  the  problems  posed  in  I. A. and  I.B. 

Specific  accon^lishments  are  as  follows. 

1)  Ccaibined  Inference  and  State  Estimation  for  Mixed  Poisson  Processes. 
A  mixed  Poisson  process  N  is  a  Cox  process  with  directing  measure  M  «  am*, 
where  a  is  a  nonnegative  random  variable  with  distribution  o  and  m*  is  a 
fixed  measure  on  the  underlying  space  E.  With  motivation  in  part  from 
Bartossydski^rown/McBride/Thonpson  (1981) ,  where  the  spread  of  cancer  is 
modeled  as  a  nonstationary  Poisson  process,  techniques  wre  developed  for< 
a)  Nonperametric  estimation  of  o  and  m*  from  independent, 
identically  distributed  (hereafter,  i.i.d.)  copies  of  the  Oox  process » 
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The  estimators  -  as  stochastic  processes  -  are  uniformly  strongly  consistent 
and  the  process  of  estimation  error  is  asymptotically  Gaussian. 

b)  State  estimation  for  the  (n+l)st  process  when  it  is  only 

partially  observed  and  O,  m*  are  unknown,  using  a  "pseudo-state**  estimator 
formed  by  using  data  frcmi  the  previous  processes  to  estimate 

relevant  fimctionals  of  a  end  m^.  The  main  results  show  that  the  difference 
between  the  true  state  estimator  and  the  pseudo-state  estimator  converges 
to  zero  at  rate  n  as  n  (the  number  of  observed  processes)  converges  to 
infinity,  in  the  sense  that  h  ^  times  the  difference  converges  in  distribution. 
These  results  appear  in 

Karr,  A.F-f  Coxnbined  nonparametric  inference  and  statd 
estimation  for  a  class  of  Cox  processes.  Technical 
Keport  354,  Department  of  Mathematical  Sciences,  The 
Johns  Hopkins  University,  1982. 

and  have  application  in  a  variety  of  fields.  The  manuscript  has  been 
accepted  tentatively  for  publication  in  Z.  Wahrscheinlichkeitstheorie  und 
verw.  Geb^ 

2)  Znference  for  Thinned  Point  Processes.  Given  a  point  process 

N  ®  Jg  on  E  and  a  function  p;  B  [0,1],  the  p-thinning  of  N  is  the 
*i 

point  process  N*  =  1^4  '  where  the  U  are  0-1  random  variables  that  are 

conditionally  independent  given  N  with  “  i|n)  =  p(X^).  Many  derived 

random  measiires  and  some  semi-Markov-modulated  Cox  processes  are  thinned 
versions  of  an  underlying  process  of  interest.  In  the  context  of  inference 
for  thinned  point  processes  the  following  problems  have  been  solved. 

a)  Development  of  nonparametric  estimators  of  the  law  of  N  and 
of  the  thinning  function  p  given  data  coiiq;»rising  i.i.d.  copies  of  the 


thinnocl  process  N* .  Minimal  knowledge  of  the  law  of  N,  namely  the  mean 
measure  but  nothing  more«  is  necessary;  the  estimators  are  strongly 
consistent  and  asymptotically  Gaussian  (as  stochastic  processes  with  a 
rather  ccxuplicated  parameter  set) . 

b)  Development  of  consistent  tests,  given  observation  of  i.i.d. 

pairs  (N^,Np  of  point  processes  satisfying  for  each  i,  of  the 

hypothesis  that  the  are  p- thinnings  of  the  for  some  unspecified  p. 

c)  Explicit  calculation  of  state  estimators  for  the  underlying 
process  N  from  observation  of  the  thinned  process  N',  when  N  is  a  Cox 
process  with  known  law  and  p  is  known.  MMSK  reconstruction  of  the 
directing  measure  M  of  N  is  also  effected. 

d)  Characterization  of  asymptotic  properties  of  pseudo-state 
estimators  when  the  are  Cox  processes  with  unknown  law  and  p  also  is 
xinknown. 

^ese  results  are  described  in 


Karr,  A.F.,  Inference  for  thinned  point  processes,  with 
application  to  Cox  processes*  Technical  Report  362, 
Department  of  Mathematical  Sciences,  The  Johns  Hopkins 
University,  1982, 


which  has  been  submitted  for  publication  in  the  Journal  of  HxiliitvaTtafo 
Anal}jsis  and  is  currently  under  review. 

3)  Estimation  of  Palm  Distributions.  As  demonstrated  in  Karr  (1983) 
the  Palm  distributions  of  a  Cox  process  play  a  fundamental  role  in  state 
estimation.  In  order  to  provide  more  widely  applicable  methodologies  for 
problems  of  combined  inference  and  state  estimation,  it  is  necessary  to 
derive  techniques  for  estimation  of  the  Palm  distributions  of  a  point 
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process  or  a  random  measure*  (As  discussed,  e.g.,  in  Xallenberg  (1982), 
the  Palm  distributions  of  a  point  process  N  can  be  interpreted  as  conditional 
distributions  of  N  given  that  atoms  of  N  are  located  at  prescribed  points 
in  E.)  These  techniques,  based  on  i*i.d*  samples  of  a  randan  measure  M, 
yield  strongly  consistent  and  asymptotically  Gaussian  estimators,  and  are 
presented  in 

Karr,  A*F.,  Estimation  of  the  Palm  distributions  of  a  random 
measure.  Technical  Report  372,  Department  of  Mathematical 
Sciences,  The  Johns  Hopkins  University,  1982, 

which  has  been  submitted  for  publication  in  the  Annals  of  Probability.  The 
results  in  it  are  very  general  and  have  extensive  potential  application. 

Current  research  is  concentrating  on  amalgamating  and  extending  the 
concepts  and  techniques  in  Karr  (1983)  and  Technical  Reports  354  and  372 
to  develop  techniques  applicable  to  virtually  all  Cox  processes.  Significant 
progress  has  been  made,  and  completion  of  a  technical  report  by  31  March, 
1983,  is  anticipated*  Thereafter,  the  research  will  turn  back  to  the  more 
specialized  problems  pinpointed  in  the  Statement  of  Research  Objectives,  as 
well  as  to  related  point  process  inference  problems. 

C)  Point  Process  Sampling  of  Stochastic  Processes.  For  binary  (i.e. , 
0-1  valued)  Markov  processes,  important  progress  has  been  made  concerning 
several  modes  of  sampling,  resulting  in  the  paper 

Karr,  A*F*,  Estimation  and  reconstruction  for  zero-one 
Markov  processes.  Technical  Report  355,  Department  of 
Mathematical  Sciences,  The  Johns  Hopkins  University,  1982, 

idiioh  has  been  accepted  for  publicaticm  in  Stochastic  FrocessBs  and  their 
ApplicationSm  Sampling  schemes  include  regular  sang^les,  regular  samples 


with  time  jitter,  Poisson  samples,  Poisson  samples  with  state  0  unobservable, 
observability  defined  by  an  alternating  renewal  process,  averaged  samples, 
observations  only  of  times  of  transitions  into  state  1,  and  point  process 
observation  of  a  random  time  change  of  the  underlying  Markov  process. 
Estimators  a(t),  b(t)  of  the  two  transition  intensities  a  and  b,  based  on 
observation  of  a  single  realization  of  the  process  over  the  time  interval 
[0,t],  are  devised  and  demonstrated  to  be  strongly  consistent  and  jointly 
asymptotically  normal.  In  many  cases  unknown  parameters  of  the  observation 
process  must  and  can  be  estimated  as  well.  Recursive  representations  of 
state  estimators  are  obtained  and  the  problem  of  state  estimation  using 
estimated  parameters  is  solved  in  rather  great  generality. 

D)  Reconstruction  of  Pet ermini st ic  Functions.  Because  of  concentration 
of  research  effort  on  other  problems  described  above,  relatively  less  effort 
has  been  allocated  to  this  area.  The  problem  of  signal  reconstruction  from 
averaged  observations  has  been  solved,  with  convergence  rates  established 
for  an  estimator  analogous  to  that  in  (1),  and  partial  results  have  been 
obtained  for  reconstruction  of  discontinuous  functions  using  the  Hausdorff 
metric  to  measure  approximation  error.  Neither  set  of  results  has  yet  been 
xitten  in  the  form  of  a  technical  report. 

III.  List  of  Written  Publications 

The  following  technical  reports  have  been  prepared  under  the  auspices 
of  this  grant  during  the  period  1  January,  1982-31  December,  1982. 
tlj  Karr,  A.P.,  Combined  nonparametric  inference  and  state  estimation  for 
a  class  of  Cox  processes.  Technical  Report  354,  Department  of 
Mathematical  Sciences,  The  Johns  Hopkins  University  (tentatively,  to 
appear  in  Z.  Wahrscheinlichkeitstheorie  und  verw*  Geh.) 


[2]  Karr,  Estimation  and  reconstruction  for  zero-one  Markov 

processes.  Technical  Rejx>rt  355,  Department  of  Mathematical  Sciences, 
The  Johns  Hopkins  University  (to  appear  in  Stochastic  Pzocess.  Appl . 

[3]  Karr,  A.F.,  Inference  for  thinned  point  processes,  with  application 
to  Cox  processes.  Technical  Report  362,  Department  of  Mathematical 
Sciences,  The  Johns  Hopkins  University  (submitted  to  J,  Multivariate 
Anal . ) . 

[4]  Karr,  A.F.,  Estimation  of  the  Palm  distributions  of  a  random  measure. 
Technical  Report  372,  Department  of  Mathematical  Sciences,  The  Johns 
Hopkins  University  (submitted  to  Ann .  Pro2>ability^  . 

The  following  manuscript  is  expected  to  be  complete  by  31  March,  1983. 

[5]  Karr,  A.F. ,  Simultaneous  inference  and  state  estimation  for  general 
Cox  processes. 

It  will  probably  be  submitted  to  Stochastic  Process,  Appl, 

rv.  Additional  Information 

A)  Mr.  David  M.  Zucker,  Ph.D.  candidate  in  the  Department  of 
Mathematical  Sciences  at  Johns  Hopkins,  has  participated  as  Research 
Assistant  in  various  phases  of  the  project.  He  is  now  engaged  in  disser¬ 
tation  research  on  a  point  process  regression  model  that  generalizes  the 
model  of  Andersen/Gill  (1982)  to  allow  time-varying  regression  parameters. 
This  work  will  be  an  important  contribution  to  the  "inference  for  point 
processes"  theme  of  the  project. 

B)  The  following  conference  papers  and  seminars  were  presented  that 
discussed  various  asj[>ects  of  the  project: 

1)  "Estimation  and  Reconstruction  for  Binary  Markov  Processes , " 
Eleventh  Conference  on  Stochastic  Processes  and  their  Applications,  Clermont- 


Ferrand,  France,  June,  1982. 

2)  "Nonpareunetric  Inference  and  state  Estimation  for  Cox  Processes,” 
Institute  of  Mathematical  Statistics  Annual  Meeting,  Cincinnati,  OH, 
August,  1982  (invited). 

3)  "Estimation  and  Reconstruction  for  Binary  Markov  Processes," 
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